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SYNCHRONIZATION OF RECURRING 
RECORDS IN INCOMPATIBLE DATABASES 

REFERENCE TO MICROFICHE APPENDIX 

An appendix (appearing now in paper format to be 5 
replaced later in microfiche format) forms part of this 
application. The appendix, which includes a source code 
listing relating to an embodiment of the invention, includes 
691 frames on 8 microfiche. ^ 

This patent document (including the microfiche appendix) 
contains material that is subject to copyright protection. The 
copyright owner has no objection to the facsimile reproduc- 
tion by anyone of the patent document as it appears in the 
Patent and' Trademark Office file or records, but otherwise ^ 
reserves all copyright rights whatsoever. 

BACKGROUND OF THE INVENTION 

This invention relates to synchronizing incompatible 
databases, 20 

Databases are collections of data entries which are 
organized, slored, and manipulated in a manner specified by 
applications known as database managers (hereinafter also 
referred to as "Applications"). The manner in which data- 
base entries are organized in a database is known as the data 25 
structure. There are generally two types of database man- 
agers. First are general purpose database managers in which 
the user determines (usually at the outset, but subject to 
future revisions) what the data structure is. These Applica- 
tions often have their own programming language and 
provide great flexibility to the user. Second are special 
purpose database managers thai are specifically designed to 
create and manage a database having a preset data structure. 
Examples of these special purpose database managers are 
various scheduling, diary, and contact manager Applications 35 
for desktop and handheld computers. Database managers 
organize the information in a database into records, with 
each record made up of fields. Fields and records of a 
database may have many different characteristics depending 
on the database manager's purpose and utility. 40 

Databases can be said to be incompatible with one another 
when the data structure of one is not the same as the data 
structure of another, even though some of the content of the 
records is substantially the same. For example, one database 
may store names and addresses in the following fields: 45 
FIRST _NAME, LAST_NAME, and ADDRESS. Another 
database may, however, store the same information with the 
following structure: NAME, STREET_NO., STREET_ 
NAME, CITY_STATE, and ZIP. Although the content of 
the records is intended to contain the same kind of 50 
information, the organization of that information is com- 
pletely different. 

It is often the case that users of incompatible databases 
want to be able to synchronize the databases. For example, 
in the context of scheduling and contact manager 55 
Applications, a person might use one Application on Lhe 
desktop computer at work and another on his handheld 
computer or his laptop computer at home. It is desirable for 
many of these users to be able to synchronize the entries on 
one with entries on another. However, the incompatibility of 60 
the two databases creates many problems that need to be 
solved for successful synchronization. The U.S. patent and 
copending patent application of the assignee hereof, Intel- 
ULink Corp., of Nashua, N.H. (U.S. Pat. No. 5,392,390; U.S. 
application, Ser. No. 08/371,194, filed on Jan. 11, 1995, now 65 
U.S. Pat. No. 5,684,990, incorporated by reference herein) 
show two methods for synchronizing incompatible data- 
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bases and solving some of the problems arising from incom- 
patibility of databases. However, other problems remain. 

One kind of incompatibility is when one database man- 
ager uses recurring records. Recurring records are single 
records which contain information which indicates that the 
records actually represent multiple records sharing some 
common information. Many scheduling Applications, for 
example, permit as a single record an event which occurs 
regularly over a period of time. Instances of such entries are 
biweekly committee meetings or weekly staff lunches. Other 
scheduling Applications do not use these types of records. A 
user has to create equivalent entries by creating a separate 
record for each instance of these recurring events. 

Various problems arise when synchronizing these types of 
records. Let us consider a situation when Application A uses 
recurring records while Application B does not. A synchro- 
nizing application must be able to create multiple entries for 
B for each recurring entry in A. It also must be able to 
identify some of the records in database B as instances of 
recurring records in database A. Also, many Applications 
which allow recurring records also permit revision and 
editing of single instances of recurring records without 
affecting the master recurring record. Moreover, single 
instances of a recurring event in Application B may be 
changed or deleted. The recurring master may also be 
changed which has the effect of changing all instances. 
These changes make it harder to identify multiple entries in 
database B as instances of a recurring record in database A. 
Moreover, synchronization must take these changes into 
account when updating records in one or the other database. 

SUMMARY OF THE INVENTION 

The invention provides a technique for synchronizing 
databases in which different techniques are used for storing 
a recurring event. A database in which the recurring event is, 
for example, stored as a single recurring record can be 
synchronized with a database in which the same recurring 
event is stored as a series of individual records. The indi- 
vidual records arc processed to form a synthetic recurring 
record representing the set of individual records, and syn- 
chronization decisions are based on a comparison of the 
synthetic record to the recurring record of the other database. 
Following synchronization, the synthetic record can be 
"fanned" back into the individual records to update the 
database containing individual records, and the updated 
recurring record can be written back to the other database. 
In this way, the invention avoids the problems encountered 
with prior methods, in which synchronization resulted in a 
recurring record being transformed into a scries of indi- 
vidual records. 

The invention features a computer implemented method 
of synchronizing at least a first and a second database, 
wherein the manner of storing a set of recurring instances 
differs between the first and second databases, and at least 
the first database uses a recurring record to store the set of 
recurring instances. A plurality of instances in the second 
database are processed to generate a synthetic recurring 
record representing recurring instances in the second 
database, the synthetic recurring record of the second data- 
base is compared to a recurring record of the first database, 
and synchronization is completed based on the outcome of 
the comparison. 

Preferred embodiments of the invention may include one 
or more of the following features: Completing synchroni- 
zation may include adding, modifying, or deleting the syn- 
thetic recurring record or the recurring record. Following 
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synchronization, the synthetic recurring record may be 
fanned back into a plurality of single instances. The set of 
recurring instances may be stored in the second database as 
a plurality of single instances. The set of recurring instances 
may be stored in the second database as a recurring record 5 
having a different record structure than the recurring record 
of the first database. A history file may be stored containing 
a record representative of the presence of a recurring record 
or a synthetic recurring record in past synchronizations. 

The invention may be implemented in hardware or 10 
software, or a combination of both. Preferably, the technique 
is implemented in computer programs executing on pro- 
grammable computers that each include a processor, a 
storage medium readable by the processor (including vola- 
tile and non-volatile memory and/or storage elements), at 35 
least one input device, and at least one output device. 
Program code is applied to data entered using the input 
device to pciform the functions described above and to 
generate output information. The output information is 
applied to one or more output devices. 20 

Each program is preferably implemented in a high level 
procedural or object oriented programming language to 
communicate with a computer system. However, the pro- 
grams can be implemented in assembly or machine 
language, if desired. In any case, the language may be a 
compiled or interpreted language. 

Each such computer program is preferably stored on a 
storage medium or device (e.g., ROM or magnetic diskette) 
that is readable by a general or special purpose program- 3Q 
mable computer for configuring and operating the computer 
when the storage medium or device is read by the computer 
to perform the procedures described in this document. The 
system may also be considered to be implemented as a 
computer-readable storage medium, configured with a com- 35 
puter program, where the storage medium so configured 
causes a computer to operate in a specific and predefined 
manner. 

Other features and advantages of the invention will 
become apparent from the following description of preferred 40 
embodiments, including the drawings, and from the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic drawing of the various modules 
constituting the preferred embodiment. 45 

FIG. 2 is a representation of the Workspace data array. 

FIG. 3 is the pseudocode for the Translation Engine 
Control Module. 

FIG. 4 shows the relationship between 50 

FIGS. 4A and 4B; FIGS. 4A and 4B, in combination, are 
the pseudocode for generating the parameter Table. 

FIG. 5 shows the relationship between 

FIGS. 5A and 5B; FIGS. 5 A and 5B, in combination, are 
the pseudocode for fanning a recurring record. 55 

FIG. 6 is the pseudocode for the Synchronizer loading the 
History File. 

FIG. 7 is the pseudocode for matching key fields (Key__ 
Field_Match). 6Q 

FIG. 8 is the pseudocode for loading records of 
B_Database into Workspace. 

FIG. 9 is the pseudocode for A_Sanitization of 
B„Database records in Workspace. 

FIG. 10 is the Pseudocode for a specific example of a rule 55 
of data value used for sanitization. 

FIG. 11 is the pseudocode for orientation analysis. 
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FIG. 12 is the pseudocode for Conflict Analysis And 
Resolution (CAAR). 

FIG. 13 is the pseudocode for analyzing unique ID 
bearing Fanned Instance Groups (FIGs). 

FIG. 14 is the pseudocode for expanding CIGs created 
from unique ID bearing records. 

FIG. 15 is the pseudocode for finding weak matches for 
a record. 

FIG. 16 shows the relationship between FIGS. 16A and 
16B; 

FIGS. 16A and 16B, in combination, are the pseudocode 
for finding matches between recurring items and non__ 
unique ID bearing instances. 

FIG. 17 is the pseudocode for completing Same Key 
Group (SKG) analysis. 

FIG. 18 is the pseudocode for selling the Maxim um_ 
CIG_Size for every CIG analyzed in FIG. 17. 

FIG. 19 shows the relationship between 

FIGS. 19A and 19B; FIGS. 19Aand 19B, in combination, 
are the pseudocode for setting CIG_Types. 

FIG. 20 is the User Interface for conflict resolution when 
the Notify option is selected. 

FIG. 21 is the pseudocode for merging exclusion lists. 

FIG. 22 is a look up table used by the function in FIG. 21. 

FIG. 23 is a look up table used by the function in FIG. 21. 

FIG. 24 is a look up table used by the function in FIG. 21. 

FIG. 25 shows the relationship between FIGS. 25 A and 
25B; 

FIGS. 25A and 25B, in combination, are a pseudocode for 
unloading records from Workspace to a non -rebuild-all 
database. 

FIG. 26 shows the relationship between FIGS. 26A, 26B, 
26C, and 26D; 

FIGS. 26A,26B, 26C, and 26D in combination, illustrate 
the look up table for determining loading outcome results. 

FIG. 27 shows the relationship between FIGS. 27A and 
27B; 

FIGS. 27A and 27B, in combination, are the pseudocode 
for fanning recurring records of A-Database for unloading. 

FIG. 28 is the pseudocode for unloading the History File. 

FIG. 29 is a table showing cases in which Recurring 
Masters are fanned into own database. 

FIG. 30 is the pseudocode for loading records by a fast 
synchronization Translator. 

FIG. 31 shows the relationship between FIGS. 31A and 
31B; 

FIGS. 31A and 31B, in combination, are the pseudocode 
for loading records by a fast synchronization Translator. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

FIG. 1 shows the relationship between the various mod- 
ules of the preferred embodiment. Translation Engine 1 
comprises Control Module 2 and Parameters Table Genera- 
tor 3. Control Module 2 is responsible for controlling the 
synchronizing process by instructing various modules to 
perform specific tasks on the records of the two databases 
being synchronized. The steps taken by this module are 
demonstrated in FIG. 3. The Parameters Table Generator 3 
is responsible for creating a Pararneter___Table 4 which is 
used by all other modules for synchronizing the databases. 
Details of the Parameler„Table are described in more detail 
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below. The Synchronizer 15 has primary responsibility for 
carrying out the core synchronizing functions. It is a table- 
driven code which is capable of synchronizing various types 
of databases whose characteristics are provided in the 
Parameier_Table 4. The Synchronizer creates and uses the 5 
Workspace 16, which is a temporary data array used during 
the synchronization process. 

A Translator 5 (A_Translator) is assigned to the 
A_dalabase 13 and another Translator 9 (B„Translator) to 
the B_database 14. Each of the database Translators 5 and ]0 
9 comprises three modules: Reader modules 6 and 10 
(A_Reader and B_Reader), which read the data from the 
databases 13 and 14; Unloader modules 8 and 12 
(A_Unloader and B_Unloader), which analyze and unload 
records from the Workspace into the databases 13 and 14; 15 
and Sanitizing modules 7 and 11 (A_Sanitizer and 
B_Sanitizer), which analyze the records of the other data- 
base loaded into the Workspace and modify them according 
to rules of data value of its own database. In the preferred 
embodiment, the modules of the A_Translator 5 are 20 
designed specifically for interacting with the A„database 13 
and the A_Application 17. Their design is specifically based 
on the record and field structures and the rules of data value 
imposed on them by the A^Application, the Application 
Program Interface (API) requirements and limitations of the 25 
A ^Application and other characteristics of A_Database 
and A__Application. The same is true of the modules of 
B_Transbtor 9. These Translators are not able to interact 
with any other databases or Applications. They are only 
aware of the characteristics of the database and the Appli- 30 
cation for which they have been designed. Therefore, in the 
preferred embodiment, when the user chooses two Applica- 
tions for synchronization, the Traaslation Engine chooses 
the two Translators which are able to interact with those 
Applications. In an alternate embodiment, the translator can 35 
be designed as a table-driven code, where a general Trans- 
lator is able to interact with a variety of Applications and 
databases based on the parameters supplied by the Transla- 
tion Engine 1. 

Referring to FIGS. 1, 2 and 3, the synchronization process 40 
is as follows. The Parameter _Table 4 is generated by the 
Parameter Table Generator 3. The Synchronizer 15 then 
creates the Workspace 16 data array and loads the History 
File 19 into the Workspace 16. The B_Reader module 11 of 
the B_Translator reads the B„databasc records and sends 45 
them to the Synchronizer for writing into the Workspace. 
Following the loading of B_Database records, the 
A_Sanilizer module 8 of the A__TransIator 5 sanitizes the 
B_Records in the Workspace. The A_Reader module 7 of 
the A_Translator 5 then reads the A_Databasc records and 50 
sends them to the Synchronizer 16 for writing into the 
Workspace. The B_Sanitizer module 12 of the 
B_Translator 9 then sanitizes the A_Records in the Work- 
space. The Synchronizer then performs the Conflict Analysis 
and Resolution (CAAR) on the records in Workspace. At the 55 
end of this analysis the user is asked whether he/she would 
like to proceed with updating the A__ and B_databases. If 
so, the B_Unloadcr module of the B_Translator unloads 
the appropriate records into the B_database. The 
A„Unloader module 6 then performs the same task for the 60 
A_Database. Finally, the Synchronizer creates a new His- 
tory File 19. 

FIG. 3 is the pseudocode for the preferred embodiment of 
the Control Module 2 of the Translation Engine 1. Control 
Module 2 first instructs the Parameter Table Generator 3 of 65 
the Translation Engine 1 to create the Parameter__Table 
(Step 100). FIGS. 4A and 4B are the pseudocode for the 
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preferred embodiment of the Parameter Table Generator 
module 3. The user is first asked to choose whether to use a 
previously chosen and stored set of preferences or to enter 
a new set of preferences (Step 150). Steps 151-165 show the 
steps in which the user inputs his/her new preferences. In 
step 152, the user chooses whether to perform a synchroni- 
zation from scratch or an incremental synchronization. In a 
synchronization from scratch, synchronization is performed 
as if this was the first time the two databases were being 
synchronized. In an incremental synchronization, the His- 
tory File from the previous file is used to assist with 
synchronization. The user will likely choose incremental 
synchronization if there has been a prior synchronization, 
but the user may choose to synchronize from scratch where 
the user would like to start with a clean slate (perhaps due 
to significant change in the nature of the data in the 
databases). The user then selects the two Applications and 
related databases (A_Database and B_Database) to be 
synchronized (step 153). The user then chooses (step 154) 
whether the Synchronizer should use the default field map- 
ping for those two databases during synchronization or the 
user will modify the field mapping. Field mapping is gen- 
erally described in U.S. Pat. No. 5,392,390 (incorporated by 
reference). In accordance with the user's preferences, the 
Parameter Table Generator then stores the appropriate 
A_Database to B_Database fields map (A-*B _Map) and 
B_Databasc to A_Database fields map (B-*A_Map) in the 
Parameter_Table (Steps 155-158 and 159-163, 
accordingly). 

If in step 150 the user selected to use previously chosen 
and stored set of preferences (steps 166-171), those prefer- 
ences are loaded and stored in the Parameter_Table (steps 
169-170). 

In case of date bearing records such as appointments and 
T0D0 lists, the user enters the date range for which the user 
wants the records to be synchronized (step 172). The pre- 
ferred embodiment allows the user to use relative date 
ranges (Automatic_Date_Range) (substeps 171 (a) and 
(£>)). For example, the user can select the date range to be 30 
days into the past from today's date and 60 days into the 
future from today's date. The Parameter Table Generator 3 
then calculates and stores in the Parameter _Table the Start 
Current_Date_Range and End_Current_Date_Rangc 
values, the two variables indicating the starting point and the 
ending point of the date range for the current synchroniza- 
tion session (step 173-174). 

In steps 174 and 175, various parameters identifying the 
characteristics of the A_Database and Application and 
B__Database and Application are loaded from a database 
(not shown) holding such data for different Applications. 
These are in turn stored in the Parameter__Table. One of the 
sets of parameters loaded and stored in the Parameter_Table 
is the Field_T-ist for the two databases. The FieId_T ,ist_A 
and Field„_List_B contain the following information about 
each field in the data structure of the two databases: 

1 . Field name. 

2. Field Type. 

3. Field Limitations. 

4. No_Reconcile Flag. 

6. Key_Field Rag. 

7. Mapped_Field Flag. 

Field name is the name given to the field which the Trans- 
lator for this Application uses. This name may also be the 
name used by the Application. Field Type identifies to the 
Synchronizer 15 the nature of the data in a field, e.g., Data, 
Time, Boolean, Text, Number, or Binary. The Field Name 
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does not supply this information to the Synchronizer. Field 
Limitations identifies the various limitations the database 
manager imposes on the contents of a field. These limita- 
tions include: maximum length of text fields, whether the 
text field musi be in upper-case, range of permissible values 5 
(for example, in ToDo records priority field, the range of 
permissible values may be limited from 1 to 4), and whether 
a single line or multiple line field. 

No_Reconcile flag indicates whether a field is a 
No__Reconcile field, meaning thai it will not be used to 1Q 
match records nor will it be synchronized although it will be 
mapped and possibly used in synchronization. Almost all 
fields will not be designated as No_Reconcile. However, 
sometimes it is necessary to do so. Key_Field flag indicates 
lhat a field should be considered as a key field by the 15 
Synchronizer 15. 

Key fields arc used by the Synchronizer in various stages 
of synchronization as will be discussed in detail below The 
decision of identifying certain fields as key is based on 
examining the various Applications to be synchronized, their 20 
data structure, and the purpose for which the database is 
used. Such examination reveals which fields would best 
function as key fields for synchronization. For example, for 
an address book database, the lastname, firstname, and 
company name field may be chosen as key fields. For 25 
Appointments, the date field and the description field may be 
chosen as key fields. 

Mapped_ Field Hag indicates whether a field is mapped at 
all. The Synchronizer uses this flag to determine whether it 
should use the A-*B_Map or B-*A_Map to map this field. 30 
Unlike a No_ReconciIe field, an unmapped field will not be 
carried along through the synchronization. 

Another set of parameters in the Parameter_Tab1e iden- 
tify the Translator Modules 13, 14 for the two Applications 
which the user has selected. Because each Application is 35 
assigned its own Translator, it is necessary to identify to the 
Command Module and the Synchronizer which Translators 
should be used. 

In step 102 of FIG. 1, the Translation Engine instructs the 
Synchronizer to load the History File. History File is the file 40 
which was saved at the end of last synchronization. It 
contains the history of the previous synchronization which is 
necessary for use with the current synchronization in case of 
Incremental Synchronization. Records from the 
A„Databasc and B_Database arc analyzed against the 45 
records of the history file to determine the changes, 
additions, and deletions in each of two databases since last 
synchronization and whether additions, deletions, or updates 
need to be done to the records of the databases. Referring to 
FIGS. 5A and 5B, in steps 200-201, the Synchronizer finds 50 
the appropriate History file to be loaded. If 
Synchronization_from„Scratch flag is set, the History File 
is deleted (step 203). If no History File is found, the 
synchronization will proceed as if it was a synchronization 
from scratch (step 204). If the Field Lists stored in the 55 
History File are not the same as the current Field Lists in the 
Parameter_Table, or the mapping information is not the 
iarae, the synchronization will proceed as synchronization 
from scratch because the differences indicate that the His- 
tory File records will not properly match the database 60 
records (steps 206-209). 

In step 210, the Synchronizer uses the Field_List for 
database B to create the Workspace 16. It is a Urge record 
array which the Synchronizer uses during synchronization. 
Referring to FIG. 2, Workspace 16 consist of two sections. 65 
First, the Synchronizer uses the Field List for the 
B_Database to make a record array 21 which has all the 
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characteristics of the B_Database record structure. In 
addition, in each record in the Workspace, certain internal 
fields are added. One field is _subtype containing Origin 
Tags. Two other fields, called Repjasic and Rep_JExcl, 
are included for all Appointment and ToDo Sections. The 
Rep_Basic field gives a full description of the recurrence 
pattern of a recurring record. It includes the following 
parameters: 

1. Basic__Repeat_„Type 

2. Frequency 

3. StopDatc 

4. other parameters 

5. Rep_Excl 

Basic_Repeat_Type contains the variable which indi- 
cates whether the recurring record is a daily, weekly, 
monthly (same date each month), monthly by position (e.g., 
3rd Friday of each month), yearly (e.g., July 4th each year), 
yearly by Position (e.g., 3rd Friday of September each year), 
quarterly, etc. This variable is set to No_Repeat for non- 
recurring records. 

Frequency indicates whether the pattern is, for example, 
for every week, every other week, etc. StartDate and Stop- 
Date show the first date and last dale in the pattern. Some 
other parameters in the Rep_Basic include, for example, a 
list of days to be included for the pattern (e.g. I plan to hold 
a weekly staff meeting every Thursday starting Nov. 15, 
1997.) 

Rep__Excl is the exclusion list. It is a list of dates which 
at some point belonged to the recurring record, but have 
since been deleted or modified and no longer are an event 
represented by the recurring record. 

Since some databases do not provide for recurring types 
of records, the synchronization process sometimes must 
create single records for each of the instances of a recurring 
record for those databases. For example, for a recurring 
lunch every Thursday, the synchronization must produce a 
single record for each Thursday in such a database. This is 
accomplished by the process of fanning which uses Rep_ 
Basic. Each of those instances is called a fanned instance. 
FIG. 6 sets out the preferred embodiment of the process of 
fanning a record. 

Fanning of recurring records also takes into account 
another set of coasidera lions regarding date range limita- 
tions and usefulness of instances to the user. 

First, fanning is limited to the applicable date range. 
Second, the number of fanned instances is limited. When 
synchronizing Databases A and B, the preferred embodiment 
permits different sets of limits on fanned instances to be 
established for each Database. This, for example, assists 
with managing storage capacity of a memory-constrained 
handheld device when being synchronized with a database 
on a desktop PC. 

If the current Date Range is large enough to accommodate 
more than the maximum number of instances which might 
be generated, those instances will be chosen which arc likely 
to be most aseful to the user. In the preferred embodiment, 
it is assumed that future instances are always more useful 
than past instances, that near future instances are more 
useful than distant future instances, and that recent past 
instances are more useful than distant past instances. 
Therefore, based on these assumptions, a fanning date range 
is calculated (FIG. 6, step 236). 

Referring to FIG. 2, in the second step of creating the 
Workspace, the Synchronizer establishes an Extended Index 
Array 20 which has an index entry associated with each 
entry in the record array. Each index contains the following 
variables: 
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1. Next_ln_CIG: 

2. Next_In_SKG: 

3. Next_In_FIG 

4. Key_FieId_Hash 

5. A_Umque_ID_Hasb 

6. B_Unique_ID__Hash 

7. Non_Key„Field__Hash 

8. Non__Date_Hash 

9. Exclusion_List__Hash 

10. Start_Date&Time 

11. End_Date&Time 

12. Various bit flags 

Next_Jn_CIG is a linkage word, pointing to next mem- 
ber of the same Corresponding Item Group (CIG). A CI G is 
a group of records, one from each database and the History 
File, if applicable, which represent the same entry in each of 
the databases and the History File. There may be one, two 
or three records in a CIG. Nexr_In_SKG is a linkage word, 
pointing to next member of the Same Key Fields Group 
(SKG). An SKG is a group of records having the same key 
fields. Next_In_FIG is a linkage word, pointing to the next 
member of the Fanned Instances Group (FIG). A FIG is the 
group of fanned instances which correspond to a single 
recurring record. 

Key_Field_Hash is hash of all Key_Fields. A__unique_ 
ID_Hash is hash of unique ID, if any, assigned by 

A_Database. B_unique ID__Hash is hash of unique ID, if 

any, assigned by B_Database. Non__Key_FieId__Hash is 
hash of all Non-Key Match Field, a Match Field being any 
mapped field which is not flagged as No_Reconcile. Non_ 
Datc_Hash is hash of all Non-Date Non-Key Match Fields. 
Exclusion List Hash is hash of recurring record's exclu- 
sion list. 

Start_Datc&Time and End_Date&Timc arc used for 
Appointment and ToDo type record only, indicating the start 
and end date and time of the record. They are used to speed 
up comparing functions throughout the synchronization. 
Hash values are also used to speed up the process of 
comparison. The preferred embodiment uses integer hashes. 
Hash value computation takes into account certain rules of 
data value for fields, as will be described in more detail 
below. 

Jn the preferred embodiment, the record array 21 is stored 
on magnetic disk of a computer whereas the Extended Index 
20 is held resident in memory. The Extended Indexes have 
record pointer fields which point to each of the records on 
the disk file. 

The Control Module 2 now instructs the synchronizer to 
Load the History File into the Workspace (FIG. 3, step 102). 
Referring to FIG. 6, the synchronizer loads the records 
beginning in first available spot in the Workspace (step 211). 
The Synchronizer then performs an analysis on each of the 
record^ and resets some of the values in the records (steps 
212-228). The records arc also checked against the current 
dale range and those falling outside of it are marked appro- 
priately for Fast synchronization function, which will be 
described below. In case of recurring records, if any of the 
instances is within the current date range, then the recurring 
record itself will be considered within the current date range 
(steps 217-227). 

The synchronizer then builds SKGs by finding for each 
history record one record which has matching key fields and 
by placing that record in the SKG of the history record (step 
215-216). Referring to FIG. 7, steps 250-258 describe the 

Key„FieId Match function used for matching records for 

SKG. 
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When comparing two records or two fields, m the pre- 
ferred embodiment, the COMPARE function is used. The 
COMPARE function is intelligent comparison logic, which 
takes inio account some of the differences between the rules 
5 of data value imposed by the A_Application and the 
B_Application on their respective databases. Some 
examples are as follows. The COMPARE function is insen- 
sitive to upper aud lower case letters if case insensitive field 
attribute is present. Because some Applications require 

10 entries to be in all capital letter, the COMPARE function 
ignores the differences between upper and lowercase letters. 
The COMPARE function takes into account any text length 
limitations. For example, when comparing "App" in the 
A_Database and "Apple" in the B„Database, the COM- 

15 PARE function takes into account thai this field is limited to 
only 3 characters in the A__Database. It also takes into 
account limits on numerical value. For example, priority 
fields in the A_Application may be limited to only values up 
to 3, whereas in the B_Application there may not be any 

20 limitation. The COMPARE function would treat all values in 
B_re cords above 3 as 3. 

The COMPARE function may ignore various codes such 
as end of line characters- It may strip punctuation from some 
fields such as telephone numbers and trailing white space 

25 from text fields (i.e "Hello " is treated as "Hello")- It also 
considers field mapping. For example, if the only line that is 
mapped by the A-*B_Map is the first line of a field, then 
only that line is compared. When comparing appointment 
fields, because different databases handle alarm date and 

30 time differently when Alarmfiag is false, the COMPARE 
function treats them as equal even though the values in them 
arc not the same. It skips Alarm Date and Time, if the Alarm 
Flag is False. It also ignores exclusion lists when comparing 
recurring records. 

35 In an alternate embodiment, the COMPARE function may 
take into account more complicated rules for data value of 
the two Applications, such as the rules for data value 
imposed by Microsoft Schedule+, described above. Such a 
COMPARE function may be implemented as a table driven 

40 code, the table containing the rules imposed by the 
A„Application and the B_Application. Because the COM- 
PARE function has a specific comparison logic and takes 
into account a number of rules, the hashing logic must also 
follow the same rules. It should be noted that the COMPARE 

45 function is used throughout the preferred embodiment for 
field comparisons. 

Now that the Historv File is loaded into the WorksDace. 
the Control Module 2 instructs the B_Translator 13 to load 
the B_Database records (FIG. 3, step 103). Referring to 

so FIG. 8, steps 300-308, the B_Reader module 11 of the 
B_Translator 13 loads each B_record which has the right 
Origin Tag, which will be explained in more detail below. 

The record must also be within the loading date range, 
which is a concatenation of the previous and current date 

55 ranges. The B_Translator sends these records to the Syn- 
chroniy^r which in turn stores them in the Workspace. When 
synchronizing with a date range limitation, all records which 
fall within either the previous or the current daLe ranges are 
loaded. The current date range is used during unloading to 

60 limit the unloading of the records to only those records 
which fall within the database's current date range. In an 
alternate embodiment of the invention, each database or 
Application can have its own date range for each synchro- 
nization. 

65 Most Applications or databases permit record -specific and 
field-specific updates to a Database. But some Applications 
or databases do not. Instead the Translator for these Appli- 
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cation must re-create the whole database from scratch when 
unloading at the end of synchronization. These databases are 
identified as Rebuild_All databases. To accommodate this 
requirement all records from such a database must be loaded 
inlo (he Workspace, so that they can later be used to rebuild 5 
the whole database. These databases records, which would 
otherwise have been filtered out by the date range or the 
wrong origin tag filters, are instead marked with special flag 
bits as Out_Of_Range or Wrong_Section_Subtype. These 
records will be ignored during the synchronization process 10 
but will be written back unmodified into the database from 
which they came by the responsible Unloader module 6, 10. 

Control Module 2 next instructs the A_TransIator 5 to 
sanitize the B-records. Referring to FIG. 9, steps 350-361, 
the A_Sanitizer module 8 of the A_Translator 5 is designed is 
to take a record having the form of an A_Record and make 
it conform to the specific rules of data value imposed by the 
A-_AppIication on records of the A_JDatabase. A_Samtizer 
is not aware which database's field and records it is making 
lo conform lo its own Application's formal. It is only aware 20 
of the A_Application's field and record structure or data 
structure. Therefore, when it requests a field from the 
sanilizer using the A„Database field name, it is asking for 
fields having the A_Database data structure. The 
Synchronizer, in steps 375-387, therefore maps each record 25 
according to the B-»A_Map. In turn, when the Synchro- 
nizer receives the fields from the A_S ANIT1 ZER, it waits 
until it assembles a whole record (by keeping the values in 
a cache) and then maps the record back inlo the B format 
using the A-*B_Map. 30 

I low a record or a field is sanitized in step 354 and 357 
depends on the rules of data value imposed by the 
A_Applicalion. For example, all of the logic of intelligent 
comparison in the COMPARE function described above can 
be implemented by sanitation. However, sanitization is 35 
best suited for more complex or unique types of database 
rules for data value. For example, consider the Schedule* 
rules regarding alarm bearing Tasks records described 
above. FIG. 10 shows a sanitization method for making 
records of incompatible databases conform to the require- 40 
ments of Schedule*. Without sanitization, when a Tasks 
record of a Schedule* database is compared to its corre- 
sponding record in another database, the Tasks record may 
be updated in fields which should be blank according to the 
Schedule* rules of data value. Such an update may possibly 45 
affect the proper opera tion of Schedule* after synchroniza- 
tion. 

Referring to FIG. 11, following sanitization of all 
B_Re cords into the Workspace, the Synchronizer sets the 
values for the Extended Index of each record based on the so 
record's values (steps 451-459). Also if the records in the 
B_Database bear a unique ID, and matches for those unique 
IDs are found in the H_Records in the Workspace, the two 
records are joined in a CIG because they represent the same 
record in both History File and B_Database (step 462). The 55 
record is also joined to an SKG it may belong lo (step 464). 
The loading of B_JUcords is now complete. 

The Control Module 2 of the Translation Engine 3 now 
instructs the A_Translator 5 to load the records from the 
A_Database (step 105). The loading process for the 60 
A_Re cords is the same as the loading process for the 
B_Database, except for some differences arising from the 
fact that records in the Workspace are stored according to the 
B_Database data structure. Therefore, as the synchronizer 
15 receives each A_record from the A_Reader module 7 of 65 
the A_Translator 5, the Synchronizer maps that record using 
the A-*-B__Map before writing the record into the next 
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available spot in the Workspace. Since the A_records are 
mapped into the B_Record format, when the B_Sanitizer is 
instructed by the Control Module 2 to begin sanitizing those 
records and starts asking for them from the synchronizer, 
they already have the B_Database format. Therefore, the 
synchronizer 15 does not need to map them before sending 
them to the B_Sanitizer module 12 of the B_Translator 19. 
For the same reason, there is no need for them to be mapped 
once they are sent back by the B_Sanitizer after having been 
sanitized. Once all the records are loaded, the records will 
undergo the same orientation analysis that the B_Records 
underwent (FIG. 11). 

At this point, all records are loaded into the Workspace. 
SKGs are complete since every record at the time of loading 
is connected to the appropriate SKG. CIGs now contain all 
records that could be matched based on unique IDs. At this 
point, the records in the Workspace will be analyzed accord- 
ing to Conflict Analysis and Resolution ("CAAR* 1 ) which is 
set out in FIG. 12 and in more detail in FIGS. 13-18 and 
corresponding detailed description. 

First, in step 500, ID bearing fanned instances in the 
History File records arc matched to the fanned instances in 
the ID bearing database from which ihey came. The records 
from the database which have remained unchanged are 
formed into a new FIG. A new Synthetic Master is created 
based on those records and joined to them. The records 
which have been changed or deleted since last synchroni- 
zation are set free as single records. They also result in a new 
exclusion list being created based on an old exclusion list 
and these new single records. 

Second, in step 501, matches are sought for the ID based 
CIGs which arc the only CIGs so far created in order to 
increase the membership of those CIGs. Preferably an exact 
all fields match is sought between current members of a CIG 
and a new one. Failing that, a weaker match is sought. 

Third, in step 502, master/instances match is sought 
between recurring records and non-unique ID bearing 
instances by trying to find the largest group of instances 
which match certain values in the Recurring Master. 

Fourth, in step 503, the items remaining in the SKGs are 
matched up based on either exact all field match or master/ 
instance match, or a weaker match. 

Fifth, in step 501, the appropriate CIG_Types are set for 
all the CIGs. CIG_Types will determine what the outcome 
of unloading the records will be. 

Referring to FIG. 13, first step in CAAR is analyzing 
unique ID bearing Fanned Instance Groups. This analysis 
attempts to optimize using unique IDs assigned by databases 
in analyzing fanned instances of recurring records. 

The analysis is performed for all Recurring Masters (i.e. 
all recurring records) which have ID-bearing fanned 
instances (or FIG records) in the H_File (step 550). All FIG 
records in the History File associated with a Recurring 
Master are analyzed (steps 551-559). They are all removed 
from the SKG. If a FIG record is a singleton CIG, it means 
that it was deleted from the database since the previous 
synchronization. Therefore, it is added to the New__ 
Exclusion_List (step 553). If a FIG record is a doubleton 
and is an exact match, it means that the record was not 
modified since the previous synchronization. In this case, the 
record from the database is also removed from SKG (step 
555). If a FIG record is a doubleton but is not an exact match 
for its counterpart in the database, it means that the record 
was changed in the database. The History File record is 
treated as a deletion and therefore added to the New_ 
Exclusion_List. The modified record in the database, which 
does not match the recurring record any longer, is treated as 
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a free standing record un- associated with the Recurring 
Master (step 557). 

Upon analysis of all FIG records, a new record, the 
Synthetic Master, is created and joined in a CIG with the 
Recurring Master (step 231-236). The Synthetic Master has 
the same characteristics as the Recurring Master, except that 
it has a new exclusion list which is a merger of the 
New_Exclusion„list and the Exclusion_List of the Recur- 
ring Master (step 563). Also a new FIG is created between 
the Synthetic Master and the CIG-mates of all FIG records 
from the History File (step 565). 

In steps 567-569, the Synchronizer checks to see if there 
are some instances of the Recurring Master which fall within 
the previous synchronization's date range but fall outside of 
the current synchronization's date range. If so, the Fan_ 
Out_Creep flag is set, indicating that the date range has 
moved in such a way as to require the record to be fanned 
for the database before unloading the record. The Fan_ 
Out_Creep flag is an increase in the value in the Non_ 
Key_ Field Hash of the Recurring Master. In this way, the 
Recurring Master during the unloading of the records will 
appear as having been updated since the last synchronization 
and therefore will be fanned for the current date range. 

In step 570, all the FIG records analyzed or created in this 
analysis are marked as Depend ent_FIGs. This results in 
these records being ignored in future analysis except when 
the recurring records to which they arc attached arc being 
analyzed. 

At the end of the above analysis, all the records having a 
unique ID assigned by their databases have been matched 
based on their unique ID. From this point onward, the 
records which do not have unique IDs must be matched to 
other records based on their field values. In the preferred 
embodiment, there are two categories of field value matches: 
strong matches and weak matches. A strong match between 
two records that have matching key fields is when non-key 
fields of the two records match or it is a Recurring Master 
and a fanned instance match (FIG. 14, steps 606-610). 
Referring to FIG. 15, a weak match between two records that 
have matching key fields is when the following are true: 
each of the two records are from different origins, because 
two records from the same source should not be in a CIG 
(e.g., A_Databa.se and History File); each is not a weak 
match for another record because there is no reason to prefer 
one weak match over another; each is not a Dcpendent_FIG 
since these records do not have an independent existence 
from their recurring masters; Dotn records are either recur- 
ring or non-recurring since a recurring and a nonrecurring 
should not be matched except if one is an instance of the 
other in which case it is a strong match; and, in case of 
non-recurring, they have matching Key„Date__Field which 
is the same as the Star t_Date in the preferred embodiment 
because items on the same date are more likely to be 
modified versions of one another. 

Referring to FIG. 14, these two types of matching arc used 
to match records to existing CIGs for History File records 
which have been created based on matching unique IDs. 
Only doubleton CIGs are looked at, because singleton CIGs 
are handled in step 504 of FIG. 12 and tripleton CIGs are 
complete (steps 601-604). If a strong match is found, then 
if the record was a weak match in another CIG, it is removed 
from that CIG, and new weak match is found for that CIG 
(612-614). While weak matches are left in SKGs in case 
they will find a strong match, strong matches are removed 
from their SKGs (step 614). If a strong match is not found, 
then a weak match is sought (steps 617-620). All records in 
the CIG are removed from SKG if no weak match is found, 
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because this means that there is no possibility of even a weak 
match for this record (step 619). 

The next step in CAAR is finding non-unique ID bearing 
instances for recurring items (FIG. 12, step 503). Referring 
5 lo FIGS. 16A and 16B, this analysis takes place only if the 
database from which instances matching a recurring record 
are sought does not provide unique ID or if we are synchro- 
nizing from scratch (steps 650-653). The goal of this 
analysis is to find matching instances for each Recurring 
m Master from a different source than the Recurring Master. 
This analysis counts the number of records in SKG of the 
Recurring Master which have matching Non_Date_Hasb 
value (steps 665-669). The group of matching SKG records 
having the same non_Date_Hash value and having the 
is highest number of members (if the number of members 
exceeds 30% of unexcluded instances) is then formed into a 
Homogeneous_Jnstances_Group (steps 670-672). A Syn- 
thetic Master is created using the Rep_JBasic of the Recur- 
ring Master and using the values from the homogeneous 
20 instances group. An Exclusion list is created based on the 
items belonging to the recurrence pattern but missing from 
the Homogeneous_lnstances_Group. The Synthetic Master 
is added to the CIG of the Recurring Master (steps 
673-678). A new FIG for the Synthetic Master is then 
25 created using the Homogeneous_Insiances_Group (step 
679). These records are removed from any CIGs to which 
they belonged as weak matches and new weak matches are 
sought for those CIGs (steps 680-684). Since the records in 
Homogeneous_Instances_Group have now been matched 
30 to a recurring record, they are marked as Dependent__FIGs 
(step 683). The Recurring Master's CIG is then marked with 
Fan_Out_Crccp flag, if necessary (step 685). 

The next step in CAAR is completing analysis of records 
in SKGs (FIG. 12, step 504). Referring to FIG. 17, this 
35 analysis attempts to increase the population of CIGs up to a 
maximum by finding key field based matches with records 
from a source different from those of the CIG records. This 
analysis is performed by analyzing all the records in the 
SKGs except for the singleton SKGs (steps 703 and 712). 
40 The first thing is to remove any members that have already 
been marked as WEAK matches attached to ID-based 
doubleton CIGs. Those are left in the SKG up to this point 
to allow for the possibility that a STRONG match would be 
found instead. But that is not possible any longer (steps 
45 7 13-71 5). Once the weak matches have been removed, all 
remaining SKG members belong to singleton CIGs. Any 
non-single ton CIGs which are formed from here on will be 
purely key field based. 

Throughout the remaining SKG Analysis we are careful 
so not to seek H_Record-A__Record or H_Record-B_Record 
matches for unique ID -bearing Source, since that would 
violate the exclusively ID-based matching scheme that 
applies in such cases. Note however that an A_Record-B_ 
Record match is acceptable even if both A_Database and 
55 B_Databasc are unique ID-bearing databases. 

Given that Key Field should not be performed where ID 
based matches are available (or otherwise there may be 
matches between records with differing IDs), there are limits 
to how big CIGs can get at this point. If both A and 
B_Databases are unique ID-bearing, any remaining 
H_Record must remain in Singleton CIGs, because they are 
prohibited from forming key fields based matches with items 
from either databases. Such H_Records are simply removed 
from the SKG when they are encountered. If just one of the 
65 two databases being synchronized is unique ID -bearing then 
the maximum population that any CIG can now attain is 2 
(FIG. 18, steps 750-751). If neither database is unique ID 
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bearing then the CIG_Max„Size is three. For every CIG default, or the user's case by case decision must be used to 

which is analyzed in FIG. 17, the CIG_Max_Size is set determine how the records from the databases should be 

according to this logic. When a CIG reaches its maximum synchronized. CIG types 012 and 210 are cases where a 

before trying to find A-B matches. If both Databases are ? £UJ£ ^ ^ ^ ^ ^ A _ D ^ b ^ tQ ma(ch ^ 

non-unique ID-bearing then two strong matches for each d . q ^ B _ DA TABASE. The reverse is true for CIG 

H_Record, an H-A and an H-B match, are sought (steps nQ wfaere fl new reCQrd is addcd to lhc B „Database. 

715-720). If finding a strong match results m reaching the 10 ^ m al ^ male embodiment, the user may be allowed to 

CIG_Max_Size, all members of the CIG are removed from register an automatic preference for how to resolve such 

the SKG (step 721). conflicts or decide on a case-by-case basis a conflict reso- 

When maximum CIG population is 3, weak matches are jution option, 

sought for strong matching CIG doubleton in order to build -phe omer lwo conflict types — 102 and 213 — are resolved 

triplet CIGs. The first weakly matching SKG member is is j n tne preferred embodiment according to the Conflict 

added to the CIG (steps 722-728). Whether or not a weak Resolution Option established by the user. First, the user 

match is found for aDy of the doubleton CIGs, its members may choose to ignore the conflict. This option leaves all 102 

are removed from the SKG (step 726). As there are no strong and 213 conilicls unresolved. Every lime synchronization is 

matches left in the SKG, weak matches are found for any repeated the conflict will be detected again and ignored 

remaining SKG members and joined lo ihem in CIGs (steps 20 again, as lung as Lhis option remains in effect and as long as 

722-725) the conflicting records are not changed by other means. 

At this stage, all CIGs arc built. They must now be The user may choose to add a new record to each of the 

examined lo determine what needs to be done lo Ihese lwo databases. This option resolves 102 and 213 conflicts by 

records so that the databases are synchronized, i.e. whether adding the new A_Record to the B_Database, and adding 

the records in the CIGs need to be added, deleted or changed 25 the new B_Record to the A Database. This option is 

in the two databases. First step is determining the CIG_ implemented by breaking a 102 CIG into two separate C Gs 

TYPE which represents the relation between the records. (lypes 100 and 001) and a 213 CIG into three separate CIGs 

The following CIG lypes are defined, all using a 3-digit (types 100, 010, and 001). Subsequent processing of those 

number that represents values found for A_DATABASE, descendant CIGs causes new records to be added across and 

History File, and B Database, respectively: 30 stored m the History File. 

1«« ~> ■ >u T. nATABACT The user may elect that A_Database records should 

1. 001-record is "new* in the —DATABASE ^ R _ databasc rccords< ^ oplion 

2. 010— record is present in History, but absent in both fe ^ lcmcnlcd by cha nging the CIG type lo 211— the 
A_Database and B_Databases processing during unloading the records changes the record 

3. 100 — record is "new" in the A_Database 3 - valuc ; n ^ e B_Database to match the current record value 

4. 101 — record is "new" in both A_Database and m the A_Database. 

B_DATABASE; same in both The user may elect that B_Database records should 

5 102— record is "new" in both A_Database and always trump or win over B_databa.se records. This option 

B DATABASE; different in each (conflict) is implemented by changing the CIG type to 112— the 

, a a^^a *v~ m n nATATiA^F 40 processing during unloading the records changes the record 

6. 110-record deleted from B_DATABASE P ^ ^ ^ m]m tQ mMch ^ record vahie 

7. 011— record deleted from A__Database in ^ B _ Dal abase. 

8. 012 — record deleted from A_Database and changed on user may cnocise lo be notified in case of any conflict. 
B_DATABASE (DEL vs CHANGE conflict) user is nol ifi e d via a dialog box 30, shown in FIG. 20, 

9,210 record changed on A_D at abase and deleted from 45 whenever a CIG type conflict of 102 or 213 arises. The 

B_DATABASE(DEL vs CHANGE conflict) dialog box shows the record that is involved in the conflict 

10 111— record unchanged since previous synchronic- 31. It also shows the A_Database 32 and B_Daiabaac 33 

:. values for all conflicting fields, in a tabular display, with 

„ a ^*™~a «« R datara^F nnlv since Field Names appearing in the left column 34. A dropdown 

11. 112-record changed on B„DATABASE only since shown y in lhe io wer left hand corner of the dialog 
previous synchronization - 3? ^ ffers a ^ of lhree choice ^add, ienore, and update. 

12. 211— record changed on AJDatabase only since ^ user may choose to add new records or ignore the 
previous synchronization conflict. The user may also choose that the A_Record or 

13. 212 — record changed identically on both since pre- B_Record should be used to update the other record. The 
vious synchronization 5j user may a is 0 decide to create a compromise record by 

14. 213 — record changed differently on each since pre- choosing values of different fields and then choosing update 
vious synchronization (conflict) option. In this case, lhe CIG type is changed to 132, which 

15. 132— a conflict (102 or 213) was resolved by forming results in updating both databases with the new record 

a compromise value; Update both compromise record. 

16 13F-<reated when a 132 Update both CIG is Fanned 60 When the user has chosen to be notified in case of conflict 

into the D _D ATAB ASE if the user chooses to ignore conflict or lhat either the record 

FIGS 19A and 19B show the method used for setting all of the A_Database or the B_DATABASE should win, the 

except ihe last two CIG_Types which are set in other CIG type is left as a conflict CIG type (102 or 213) and a 

operations. separate Conflict Resolution Choice is stored in the FLAGS 

Four of the CIG types assigned above involve conflicts: 65 word associated with each CIG member. 

102 213, 012, and 210. Conflicts are those instances where The final step in setting CIG_Types is the process tor 

a specific conflict resolution rule chosen by the user or sel by dealing with difficulties which arise from exclusion lists. For 
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example, in a triple Recurring Master CIG, suppose the 
History File Recurring Master does not have any excluded 
instances. The A_Record has the following exclusion list: 

12/1/96, 12/8/96 
The R_Record has the following exclusion list: s 

1/1/97, 1/8/97, 1/15/97, 1/22/97, 1/29/97 

If comparison of the Recurring Masters includes compar- 
ing exclusion list Field Values, this set of changes would 
cause the Synchronizer to report a CIG type 213 conflict. 

If the Conflict Resolution Option is set to A_Da(abase 10 
record wins, then the outcome prescribed by the Synchro- 
nizer would be for the A_Database to keep its exclusion list 
as is and for the B_Database lo make its exclusion list 
match that of the A_Database. 

The result would be to have a lot of duplicate entries in 
both Databases. The A_Dat abase would have five duplicate 
entries in January 97 — that is the five unmodified Recurring 
Master instances, plus the five modified instances added 
across from B_Database to A__Database. The B_Database 
would have five duplicate entries in January 97, since 
synchronization has wiped out the five exclusions that were 20 
previously recorded in the B_Database exclusion list. 

Two steps are implemented for dealing with this problem. 
First, the COMPARE function does not take into account 
exclusion list differences when comparing recurring records. 
Second, referring to FIG. 21, any new exclusions added on 25 
to one recurring record will be added to the other record. The 
merging of exclusion lists is done regardless of any updates 
or conflicts, even unresolved conflicts, between the 
A_Database and B_Database copies of a Recurring Master. 
One exception is for CIG type 102 conflict which is left 30 
unresolved where Exclusion lists are not merged, because 
the user has chosen to leave those records as they are. 

In most cases where it is necessary to merge exclusion 
lists, the CIG types and/or the Conflict Resolution Choice to 
arrange for all necessary updates to be performed during the ^ 
unloading phases of synchronization. 

First, A_Dat abase and B_Dat abase records' exclusion 
lists are compared. In case of databases which do not permit 
recurring items, the exclusion list of the Synthetic Master is 
compared to the recurring record of the other database (step 

852) . If there is no difference, then nothing is done (step 4 0 

853) . If there are differences, then it is determined which 
exclusions appear only in one record. This comparison 
always yields one of the following scenarios: (1) all one- 
side-only Exclusions are on the A_Dat abase (so Exclusions 
should be added to the B_Databasc); (2) all one-side-only 45 
Exclusions are on the B„Database (so Exclusions should be 
added to the A_Database); and (3) there are one -side-only 
Exclusions on both sides (so Exclusions should be added to 
both databases). 

In each of these cases a separate table is used to look up 50 
instructions, for how to handle each specific situation (FIGS. 
22-24). The tables cover all possible combinations of pre- 
vious CIG types and outcome codes with all possible 
exclusion list changes (new and different exclusions added 
on A_Databasc, or on B_Database, or on both sides). FIG. 55 
22 table is used in case of scenario 1. FIG. 23 table is used 
in case of scenario 2. FIG. 24 table is used in case of scenario 
3 (FIG. 21 steps 854-856). 

The analysis of records is now complete, and the records 
can be unloaded into their respective databases, including 60 
any additions, updates, or deletions. However, prior to doing 
so, the user is asked to confirm proceeding with unloading 
(FIG. 3, step 108-109). Up to this point, neither of the 
databases nor the History File have been modified. The user 
may obtain through the Translation Engine's User Interface 65 
various information regarding what will transpire upon 
unloading. 
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If the user chooses to proceed with synchronization and to 
unload, the records are then unloaded in order into the 
B_Database, the A„Database and the History File. The 
Unloader modules 6,10 of the Translators 5,9 perform the 
unloading for the databases. The Synchronizer creates the 
History File and unloads the records into it. The Control 
Module 2 of the Translation Engine 1 first instructs the 
B_Translator to unload the records from Workspace into the 
B_Database. Referring to FIGS. 25 A and 25B, for each CIG 
to be unloaded (determined in steps 902-907), based on the 
CIG_TYPE and which database it is unloading into (i.e., A 
or B), the unloader looks up in the table in FIGS. 26A-26D 
the outcome that must be achieved by unloading — that is, 
whether to update, delete, add, or skip (Leave„Alone) (step 
908). In steps 909-913, the unloader enforces date range 
restriction for a database subject to date range. The user may 
select, or a selection may be made by default, whether to 
enforce the date range sternly or leniently. In case of stem 
enforcement, all records outside of the current date range 
would be deleted. This is useful for computers with small 
storage capacity. In case of lenient enforcement, the records 
are left untouched. 

Based on the result obtained from looking up the unload- 
ing outcome in the table, the unloader then either adds a new 
record (steps 920-926), deletes an existing record (steps 
914-919), or updates an existing record (steps 927-933). It 
should be noted that because we only update those fields 
which need to be updated (step 928), the fields which were 
sanitized but need not be updated are not unloaded. 
Therefore, the values in those fields remain in unsanitized 
form in the database. 

Referring to step 914, in some Applications when a 
Recurring Master must be added or updated, the record may 
have to be fanned out despite the ability of the Application 
to support recurring records. For example, the Schedule* 
Translator is generally able to put almost any Recurring 
Master Item into Schedule* without fanning, but there are 
some exceptions. The Schedule* Translator uses one Sched- 
ule section to handle all appointments and events. For 
appointments, almost any recurrence pattern is allowed, but 
for events the only allowable true repeat type is YEARLY. 
DAILY recurring events can be dealt with by being trans- 
lated into Schedule* multi-day events which are not recur- 
ring but extend over several days by setting the EndDate 
some time after the Start Date. But for the DAILY case there 
arc restrictions. Iu particular exclusions in the midst of a 
multi-day Schedule* event cannot be created. So the Trans- 
lator decides that if section type is ToDos or the item is a 
non-Event Appointment, then the record need not be fanned 
out. But if item is a YEARLY or DAILY with no exclusions 
then it can be stored as a Schedule* yearly or daily event. 
Otherwise, it must be fanned. 

Referring to FIGS. 27 A and 27B, steps 950-984 set out 
the preferred embodiment of fanning recurring records that 
must be updated. All cases fall within three scenarios, shown 
in FIG. 29. 

In the first scenario a record which is a Recurring Master, 
and its counterpart in the other database is a Recurring 
Master, must be fanned now for its own database (steps 
951-959). If the CIG__TYPE of the record is 132 (i.e. update 
both records), then it is changed to 13F which is a special 
value specifically for this situation (step 951). For other 
CIG_Types, the CIG is broken into three singleton and 
given CIG__Types signifying their singleton status. In both 
of these cases, the function Fanning__For„Add (steps 
986-996, described below) is called. 

In the second scenario, the record was fanned previously 
and is going to be fanned now also. First, Lhe dates of the 
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instances are recorded in a temporary dale array (steps 
961-963). This array is compared to an array of tbe fanned 
instances of tbe recurrence pattern of the C1G Recurring 
Master from the other database (steps 965-966). The dates 
which are not in the array of fanned instance aie marked for 5 
deletion (step 967). The dates which are not in the temporary 
date array should be added to the unloading databases and 
therefore new FIG records are created for those dates (steps 
968-973). The dates which appear in both mays are com- 
pared to the Synthetic Master and marked accordingly for io 
UPDATE or Leave^ Aione (sieps 974-978). 

In the third scenario, tbe record which was previously 
fanned should now be fanned also. The opposing database's 
record in this scenario is also fanned instances. This is 
perhaps the most peculiar of the three cases. For example, a 35 
database may be able to handle multi-day (i.e. daily 
recurring) records but not any exclusion dates for such 
items. Such database may be synchronized with another 
database which fans all records in the following manner. A 
record representing a 7-day vacation in the Planner section 20 
of the database is fanned out to form 7 individual vacation 
davs in the other database. One insiancc is deleted in the 
other database. Upon synchronizing the two databases, b/c 
the nrsl databases does not provide for exclusion 

lists, the record must now be fanned. 25 

In this scenario, Master Records in a CIG arc marked as 
Garbage. Any FIG members attached to the H_Rccord, if 
any, are also marked as Garbage. All Instances found in the 
opposing database's FIG are truned to singleton CIGs with 
CIG type 300 or 001 so that they will be added to the 30 
unloader's database when unloading is done. In this way the 
instances from one database is copied to the database 
providing for recurring records. 

Steps describe the Fanning_For_Add Function 

which is used when outcome is to update or when the 35 
function is called by the Translator fanning for update. For 
each instance generated by fanning out the recurring record, 
a clone of the Recurring Master is created but excluding 
Rcp_Basic and Rep_Excl field values and the unique ID 
field. All adjustable Date Fields (e.g. Start Date, End Dale, 40 
and Alarm Date) are set and hash values for the new record 
is computed. Tbe new record is then marked as Fanned_ 
For__A or Fanned_JFor„B, as the case may be. This is then 
attached to the Recurring Master Item as a FIG member. 

Following unloading of the B_RECORDS, the Control 45 
Module 2 instructs the A_Translator to unload the 
A„Records from the Workspace (FIG. 3, step 111), This 
unloading is done in the same way as it was done by the 
B_Tra relator. In case of Rebuild_AH Translators which 
have to reconstruct the database, all records which were 50 
loaded from the database but were not used in synchroni- 
zation are appended and unloaded as the Translator builds a 
new database for its Application. 

The Control Module 3 next instructs the Synchronizer to 
create a new History File (step 112). Referring to FIG. 28, 55 
for every CIG in the Workspace, it is first determined which 
record should be unloaded to Hisiory File (steps 
1001-1003). In the next step, Excl„Only flag is checked, 
which is set by the Merge_Exclusion_List logic (FIG. 
21-24). If that flag is set, a new record for unloading is 60 
created which has all fields taken from the History File 
record, except that the newly merged exclusion list is 
inserted into that record (step 1004). Before storing tbe 
record in the History File, all Flag Bits in the Extended Index 
are cleared except the bit indicating whether or not this 65 
is a recurring item (step 1005). The item is marked as a 
History File record to indicate its source. The CIG, FIG, and 
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SKG are reset. All the HASH values and 
Start &EndDate&Time will be stored. All applicable unique 
ID are also stored (Steps 1006-1009). The current record is 
then stored in the new History File (step 1010). If the current 
record is a Recurring Master for an ID-bearing FIG, we now 
store the whole FIG (i.e. all Fanned Instances) in the History 
File, with the FIG linkage words set in the Hisiory File to 
hold the FIG records together (step 1011). Fanned instances 
which do not bear unique IDs are not stored in the History 
File since they can be re-gene rated by merely fanning out the 
Recurring Master. 

Once all records are unloaded, various information nec- 
essary for identifying this Hisiory File and for the next 
synchronization are written into tbe History File (step 1013). 
At this point Synchronization is complete. 
Applications, such as scheduling Applications, often have 
more than one database. Each of these databases are known 
as sections. Each of these sections contain different data and 
must be synchronized with their corresponding sections in 
other Applications, However, there is not necessarily a one 
to one relationship between sections of various Applications. 
For example, Application A may comprise OTte. of the following 
sections: Appointments, Holidays, Business Addresses, Per- 
sonal Addresses, and ToDo. Application B however may 
comprise One 0 f the following sections: Appointments, 
Addresses, JoDo-'Jasks, and ToDo-Calls. Although the gen- 
eral character of the sections arc the same, there is not a one 
to one relation between the sections of these two Applica- 
tions: Appointments and Holidays in A contain the same 
type of data as Appointments in B; Business Addresses and 
Personal Addresses in A contain the same type of data as 
Addresses in B; and ToDo in A contains the same iypc of 
data as ToDo-Tasks and To Do- Calls in B. Therefore, when 
synchronizing the sections of these two Applications, it is 
necessary io synchronize at least two sections of one Appli- 
cation with one section of another Application. 

Tbe preferred embodiment performs this type of synchro- 
nization by providing for a number of section categories: 
Appointment, ToDo, Note, Address, and General Database. 
All sections of a particular Application arc studied and 
categorized according to this categorization. Therefore, in 
the above example of Application A, Appointments and 
Holidays are categorized Appointment type sections (or 
database), Business Address and Personal Address as 
Address type sections, and ToDo as a ToDo type section. 

For creating the map for mapping sections onto each 
other, an exact section match is always sought between 
sections of the two Applications. If not, one of the sections 
which were categorized as a section type is chosen to be the 
Main_Section among them. Other sections of the same type 
are referred to as subsections. All databases of the same type 

from the other Application will be mapped onto the Main 

Section. 

To properly synchronize from one time to the next, it is 
necessary to keep track of the source of records in the 
Main_Section. In the preferred embodiment, if a record in 
the Main_Section of the A^Applicalion does not come 
from the Main_Section of the B_Application, one of fields 
in the record, preferably a text field, is tagged with a unique 
code identifying the subsection which is the source of the 
record. This is the record's Origin Tag. All records in the 
Workspace and the History File include a hidden internal 
field called_subType which contains the unique subsection 
code. Main_Section*s field value in the preferred embodi- 
ment is zero so ihat it will not be tagged. When a record is 
loaded from a database into the Synchronization Workspace, 
the lag is stripped from the TagBearer field and put in the 
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_subType field. If there is no tag, then the _subType is set 
to be the subtype of the present section. If the TagBearer 
field is mapped then when reading records into the Work- 
space the tag, if any, is stripped from the TagBearer field 
value place it in _sublype. 5 

Conversely when unloading records from the Workspace 
to a Database, the TagBearer field is tagged by a tag being 
added if the record is not from the Main_Section. 

A Fast Synchronization database is a database which 
provides a method of keeping track of changes, deletions, 10 
and additions to its records from one synchronization to the 
next. These databases speed up the synchronization process 
because only those records which have been modified need 
to be loaded from the database. Since the majority of records 
loaded by regular Translators are unchanged records, far 15 
fewer records are loaded from the database into the Syn- 
chronizer. 

Certain features are required for a database to be a Fast 
Synchronization database. The database records must have 
unique IDs and must have a mechanism for keeping track of 2Q 
which records are added, changed, or deleted from synchro- 
nization to synchronization, including a list of deleted 
records. Unique IDs are required to accurately identify 
records over a period of time. 

There are at least two ways to keep track of additions, 25 
changes, and deletions in a database. 

First, some databases maintain one Dirty bit per record 
which is a boolean flag that is set when a record is created 
or modified and is cleared when a function for clearing Dirty 
bits is called. Some databases offer a Clear DirtyBit function 30 
that clears the bit of an individual record. Other databases 
offer a ClcarDirtyBits function that clears the Dirty bits of all 
records in a database. The record -specific Clear DirtyBit 
function allows the preferred embodiment to use the data- 
base itself to keep track of additions and changes. 35 

The global ClearDirtyBits function forces the preferred 
embodiment to clear all Dirty bits at the conclusion of every 
Synchronization. Then as database edits are made by the 
user in between synchronizations, the affected records are 
marked as Dirty. When Synchronization is performed again, 40 
only the Dirty records are loaded. 

Second, some databases maintain a Date&Time stamp of 
when the record was added or last lime the record was 
modified. A Translator for such a database finds all records 
which were added or modified since the previous synchro- 45 
nization by searching for Date&Time stamps more recent 
than the Date&Time of the Last Synchronization. 

A Fast Synchronization database must also keep track of 
deletions. This is done by maintaining a list of deleted 
records which can be read by a Translator. 50 

A Translator sending Fast Synchronization database 
records to the Synchronizer provides only records which 
have been changed, deleted, and added since the previous 
synchronization. Therefore, unlike a regular database 
Translator, a Fast Synchronization Translator docs not pro- 55 
vide the Synchronizer with unchanged records. Moreover, 
unlike a regular Translator it provides deleted records, which 
the regular Translators do not. 

In order for such databases to be synchronized without 
resorting to treating them as regular databases, the Synchro- 60 
nizer transforms Fast Synchronization records from the 
Translator into the equivalent regular database records. 
These transformed records are then used by the Synchro- 
nizer in the synchronization. There are two transformations 
which are necessary. First, the Synchronizer needs to trans- 65 
form deleted records received from the Fast Synchronization 
Translator into a regular database deletions. Second, syn- 
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chronization needs to transform lack of output by the Fast 
Synchronization Translator into unchanged records. 

The invention performs these transformations by using 
the History File. During the first synchronization, all records 
in the Fast Synchronization database are loaded into the 
history file. As changes, additions, and deletions are made to 
the Fast Synchro nization database, during each of the sub- 
sequent synchronizations the same change, additions, and 
deletions are made to the History File. Therefore, the History 
File at the end of each subsequent synchronization is an 
exact copy of the Fast Synchronization database. 

When a Fast Synchronization Translator supplies no input 
for a unique ID' H_Record, the Synchronizer finds the 
corresponding H_Record in the Workspace and copies it 
into the Workspace as a record supplied as if it were loaded 
by the Fast Synchronization translator itself. 

Referring to FIG. 30, steps 1050-1051, the Synchronizer 
first verifies that there is an appropriate History File. 
Because the Fast Synchronizing process relies heavily on the 
History File, it is important to ensure that the same history 
file as the last Synchronization is used. Moreover, the 
History File is the background against which the transfor- 
mation of the Translator outputs into regular Translator 
outputs takes place. The History File keeps a date and time 
stamp of the last synchronization. Each of the Fast Synchro- 
nization database (if able to) and the Fast Synchronization 
Translator also stores the same date and time stamp. The 
time and date stamp is used because it is unlikely that 
another History File will have exactly the same lime and 
date entry, for the same two databases. It also identifies when 
last the Fast Synchronizer database and the History File 
contained the same records. 

At the start of an incremental synchronization, the Syn- 
chronizer and the Fast Synchronization Translator compare 
date and time stamps. If time and date stamp synchroniza- 
tion parameters have changed since the previous 
synchronization, then the synchronization proceeds from 
scratch (step 1052). In a synchronization from scratch all 
records in the Fast Synchronization database are loaded into 
the History File. 

In the preferred embodiment, all records supplied as Fast 
synchronization inputs have a special hidden field called 
Jelta, which carries a single- letter value — *D' for Delete 
or 'A* for Add and *C* for Change. Records are loaded by the 
Fast Synchronization Translator into the Workspace (step 
1054)/ If necessary the records are mapped when loaded. 
Records which are marked as changes or additions are 
sanitized by the Translator for the other database, but deleted 
records are not because their field values are going to be 
deleted (step 1055). Orientation analysis (FIG. 11) is per- 
formed on the records so that all deletions and changes to 
Fast Synchronization database records are joined with their 
History File counterparts in unique ID bearing CIGs (step 
1107). 

All History File records and their CIGs are now exam- 
ined. If there is no corresponding record from the Fast 
synchronization database, it means that the record was 
unchanged. A clone of the record is made, labelled as being 
from Fast Synchronization database, and joined to the 
H_Record's CIG. At this point the deleted Fast synchroni- 
zation database records marked as deletions are removed 
from CIGs (step 1109). The Fast Synchronization records 
marked as changed are joined in double ton CIGs. Those 
marked as additions are singletons. At this point, the syn- 
chronization can proceed as if record of a unique ID bearing 
regular database were just loaded into the Workspace. 

Whenever we are loading from a Fast Synchronization 
database, all records axe loaded so that al the end of 



